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Abstract 

Closed semirings are algebraic structures that provide a unified approach to a number of seemingly 
unrelated problems of computer science and operations research. For example, semirings can be used 
to describe the algebra related to regular expressions, graph-theoretical path problems, and linear equa- 
tions. We present a new axiomatic formulation of semirings. We introduce the concept of eliminant, 
which simplifies the treatment of closed semirings considerably and yields very simple proofs of other- 
wise difficult theorems. We use eliminants to define matrix closure, formulate closure algorithms, and 
prove their correctness. 
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1 Introduction 

There are a number of important problems in computer science and operations research which had earlier 
been studied separately as seemingly unrelated problems, but have recently been recognized to be instances 
of the same general problem. Examples of these include various 'path problems' such as the determination 
of the shortest or the most reliable path or the path with the largest capacity, or the enumeration of all paths 
between each pair of points in a network (see the bibliographies on path problems [5, 12]). Other examples 
are cut-set enumeration, transitive closure of binary relations [14], finding the regular expression to describe 
the language accepted by a finite automaton [11], and compiled code optimization and data flow analysis 
[9]. 

The use of semirings as a unified approach to path problems was undertaken by a number of people 
(see [13, 16] for representative examples), and the problems were formulated in such a way that the optimal 
path computation became equivalent to the asteration (closure) of a matrix with elements from a suitable 
semiring. Later, Backhouse and Carre pointed out the similarities between the asteration or matrices over 
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semirings and the solution of linear systems of equations in ordinary algebra. It then became quite clear that, 
for example, the McNaughton-Yamada algorithm for regular expressions [11], Warshall's transitive closure 
algorithm [15], and Floyd's shortest path algorithm [6] were quite similar to the Gauss-Jordan elimination 
method in linear algebra, and that the Ford-Fulkerson shortest path algorithm [7] was similar to the Gauss- 
Seidel iteration method. 

Under different names and with differing postulates, a number of formulations have been proposed for 
the semiring structure needed to express generalized path problems (see [3] fpr extensive bibliographic 
notes on this literature). For most path problems, the operation of asteration (closure), so important in 
the case of matrices over a semiring, was trivial for the elements of the semiring themselves. As a result, 
earlier definitions of semirings (e.g., [13, 16]) did not include or emphasize the asteration of elements. The 
later formulations (e.g., [?, 2]) generalized the structure so as to represent regular expressions also. But 
by assuming addition to be idempotent or by some other too strong conditions, these structures could not 
encompass real or complex linear algebra. Thus, in spite of a close similarity between then, path problems 
and the problem of solving linear equations still could not be unified completely as instances of the same 
general problem. The final step of incorporating path problems, regular expressions, and linear systems in 
real numbers into a single framework has been undertaken by Lehmann[10] and Tarjan[14]. 

A difficulty with most of the earlier formulations was the lack of precision in their treatment of the 
operation of matrix asteration (closure). This operation was defined in terms of (1) an implicit solution 
to an equation or (2) an explicit formula containing infinite summation or (3) the result of executing an 
algorithm. In each case, it was difficult to prove the properties of asterates (closures) rigorously, for example, 
to show that two different algorithms for asteration produced the same result. Lehmann [10] gave an explicit 
definition of asterates of matrices, and proved that the algorithms essentially equivalent to Gauss- Jordan and 
Gaussian elimination techniques compiled matrix asterates correctly. 

The main contribution of our paper is to introduce the concept of eliminant, which bears some resem- 
blance to the linear algebraic concept of determinant. Eliminants serve to represent the quantities produced 
during the execution of elimination algorithms in very natural, compact, and suggestive forms. Using elimi- 
nants, we have been able to define matrix asterates as well as to prove the correctness of asteration algorithms 
much more simply than in the literature. Several otherwise difficult proofs have been reduced to elementary 
consequences of the properties of eliminants. 

Our formulation of semirings is very similar to, but slightly less general than that of Lehmann [10], 
because we include the axiom a.O = O.a = 0, which he does not. We feel that this axiom can be added without 
any sacrifice in the applicability of semirings to practical problems. On the other hand, any theoretical loss 
is more than adequately compensated by the resulting simplicity and beauty of the eliminant approach. 

This paper is divided into seven sections. Section 2 defines *-semirings as an algebraic structure. Section 
3 introduces matrix operations over semirings. Section 4 defines eliminants and presents a number of their 
interesting properties. Section 5 uses eliminants to give a very simple definition of matrix asterates. It 
also shows that the definition is suitable by proving that the relevant semiring axiom is satisfied by the 
defined asterates. Section 6 then describes two algorithms for computing the asterate of a matrix, and 
shows their correctness. The algorithms are just the *-semiring versions of the Gauss- Jordan and Gaussian 
elimination algorithms for matrix inversion. Finally, Section 7 presents an explicit solution for a linear 
system of equations. 
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2 Semirings 



Definition 2.1. A ^-semiring is a system (5, +, - ,*,0, 1) in which S is a set closed with respect to the binary 
operations + (addition) and • (multiplication) and the unary operation * (asteration), 0 and 1 are elements of 
5, and the following laws are satisfied: 



(1) 


a + {b + c) 


= (a + b)+c, 


addition is associative, 


(2) 


a + b = b-{ 


-a, 


addition is commutative, 


(3) 


a + 0 = 0, 




0 is the identity for addition, 


(4) 


(a-b) c = 


a - (b-c), 


multiplication is associative, 


(5) 


a-\ = \-a 


= a, 


1 is the identity for multiplication, 


(6) 


a-0 = 0-a 


= 0, 


0 is a zero for multiplication, 


(7) 


a-(b + c) = 


= a-b + a-c, 


multiplication is left and, 


(8) 


(a + b) c- 


- a- c + b- c, 


right distributive over addition. 


(9) 


* * 

a = a-a - 


f 1 = a*-a + l. 





The system (5,+, - ,0, 1) is called a semiring if S is possibly not closed with respect to * (a* is not defined 
for some or all a in S), but the laws (1) through (8) still hold. 

For the most part, we will denote multiplication by juxtaposition as is customary. 

Note: In the literature, asteration is usually called closure, and a *-semiring is usually called closed 
semiring. We prefer the term asteration to avoid such awkward statements as ". . . is closed with respect to 
closure". The term asterate of a for a* was coined by Conway [4]. 



Some simple examples of *-semirings are shown in Table 1. Similar tabulations have often been given 
(cf. [2, 3, 10]). 

Table 1 : Some examples of semirings 



s 


a + b 


a • b 


a* 


0 


1 


Description 


Application 


{0,1} 


a\Jb 


aAb 


1 


0 


1 


Boolean values 


Reachabilty in 
graphs; reflexive 
and transitive 
closure of binary 
relations 


R+ U {oo} 


min{a,b} 


a + b 


0 


oo 


0 


Real numbers 
augmented with the 
element oo 


Shortest paths 


R+ U {oo} 


max{a,&} 


min{a,&} 


OO 


0 


oo 


Nonnegative real 
numbers augmented 
with the element oo 


Largest capacity 
paths 


[0,1] 


ma\{a,b} 


ab 


1 


0 


1 


Real numbers between 
0 and 1 inclusive 


Most reliable 
paths 


RU{oo} 


a + b 


ab 


1/(1 -a) 
if a / 1; 

l*=oo, 

OO = OO 


0 


1 


Real numbers 
augmented with the 
element oo 


Solution of linear 
equations 
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3 Matrices over semirings 



The set of all n x n matrices over a *-semiring S = (5, +, *,0, 1) can itself be made into a semiring or *- 
semiring by suitably defining +, -, *,0, and 1 for it. We define addition and multiplication of n x n matrices 
in the usual way, and 0 = O, the matrix with all entries zero, 1=1 = (8,-y), the Kronecker 8. The size, n, of 
O and / is to be inferred from the context. 

It is now an easy matter to verify that the set of allnxn matrices over a *-semiring, together with the 
above defined addition, multiplication, O and /, forms a semiring. 

The asteration of matrices is best defined via eliminants which we introduce next. 



4 Eliminants and selects 

The theorems of this section provide some basic identities for the manipulation of eliminants which will be 
used in the subsequent sections. 

Definition 4.1. Given an n x n matrix 



a. n \ . . . a nn 
we define the eliminant of A, written elim(A) or 



a n 



a n \ . . . a nn 

as follows: For n = 1 and n = 2, the value is given explicitly: 

a b 



\a\ = a, and 



: d + ca*b. 



c d 

For n ^ 3, the value is specified in terms of a smaller order eliminant, 
an ■■■ a\ n 



a n \ ... a n 



b n ••• £i,n-i 
b n -\,\ ■■■ b n -\, n -\ 



where 



Example 



a 


b 


d 


e 


8 


h 



an a ij+i 



a b 
d e 



, l^ij^n-l. 



a b 
g h 



a c 

d f 

a c 

8 i 



e + da*b f + da*c 
h + ga*b i + sa*c 



i + ga*c +(h + ga*b) (e + da*b)*(f + da*c) 
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Definition 4.2. Given annxn matrix 
an • •• a\n 



A = 



a n i . . . Cl n n 



we define the k, i, j-select of A, written Afj, for 1 ^ i,j ^n and 0 ^ k ^ n, to be the eliminant of the matrix 
obtained by selecting the first k rows followed by the ith and the first k column followed by the jth; in 
symbols, 



an 



aik ai 



1 ^ i,j ^ n, 0 < k ^ n. 



dki ... aick auj 
an . ■ . atk ajj 

Note that, for k = 0, A*. = |a,y| = 

For annxn matrix A, AJ^ 1 is the same as elim(A), so that elim(A) 
4.1 gives 



\n— 1 



Furthermore, Definition 



elim(A) 



i 22 



L 23 



A 1 4 1 

A 32 A 33 



4 1 4 1 

A n2 A nS 



A 1 



A general relation embracing the above two as extreme cases is given by the next theorem. 

Theorem 4.3. Given annxn matrix A and an integer r, 1 ^ r ^ n — 1, let B be the (n — r)x(n — r) matrix 
specified by 

bi 

Then 



'i] — A r+i,r+ji 1 ^ hj ^ n r - 

elim(A) = elim(fi). 



Note: The construction of bij from A can be pictorially represented in terms of a partitioning of A as 
follows: 



r 


n—r 


columns 


X 


Y ' 


rrows 


z 


W 


n—r rows 



X K 



*j 



Wj 



where Z,-* and Y*j are the ith row and j'th column of Z and Y, respectively. 

Before proving the theorem, let us look at an example. For a Ax A matrix partitioned by taking r = 2, 
the theorem asserts that 



a 


b 


c 


d 


e 


f 


8 


h 


i 


j 


k 


I 


m 


n 


o 


P 



a b c 

e f 8 

i j k 

a b c 

e f 8 

m n o 



a b d 

e f h 

i j I 

a b d 

e f h 

m n p 



5 



On the other hand, by definition, the left-hand side equals 



a 


b 




a 


c 




a 


d 


e 


f 




e 


8 




e 


h 


a 


b 




a 


c 




a 


d 


i 


j 




i 


k 




i 


I 


a 


b 




a 


c 




a 


d 


m 


n 




m 


o 




m 


P 



Of course, the latter equality is also obtained from the theorem by taking r = 1 . 

Proof of Theorem 4.3. We prove the theorem by induction on r. The case r = 1 immediately follows from 
Definition 4. 1 . For r = s + 1 , let B be the (n — r) x (n — r) matrix given by 

bij = A r+i ^ r+ j, 1 $J hj *S n — r. 

We need to show that elim(A) = elim(fi). By the induction hypothesis, A r r+ir+ j or A^+} +; 5+1+ y can be 
expanded, giving 



^+1,^+1 



A s A s 

.«+ l+i,s+ 1 1 +;,«+ 1 + j 

Each element of the (n — s — 1 ) x (n — j — 1 ) matrix B is now a 2 x 2 eliminant, and Definition 4. 1 is 
applicable (in reverse) to B. Specifically, we get 

elim(fi) = elim(C), 

where C is an (n-s)x(n — s) matrix with elements Cjj = A s s+i s+ j. Using the induction hypothesis again, 
we obtain 

elim(C) =elim(A). □ 
Some easily proven properties of eliminants are given by the next three theorems. 

Theorem 4.4. A common premultiplier of the last row, or postmultiplier of the last column, can be factored 
out of an eliminant. 

Theorem 4.5. Eliminants which are equal element-by-element in all positions except in the last row ( re- 
spectively column) can be added by adding their last rows (respectively columns) element-by-element. 

Theorem 4.6. A constant can be added to an eliminant by adding that constant to the last diagonal element 
of the eliminant. 



The following equalities illustrate the use of the above theorems: 
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a b c 
d e f 
mg mh mi 

a b cm 
d e fm 
g h im 

a b 



m 



a b c 
d e f 
g h i 

a b c 
d e f 
g h i 



m, 



+ 



+ 



c d 

a b 

c d 

a b c 

d e f 

g h i 



a b 

e f 

a e 

c f 

+ k = 



a b 
c+e d+f 

a b + e 
c d + f 

a b c 
d e f 
g h i + k 



Theorem 4.7. If the last row (respectively column) of an eliminant consists of zeros except, possibly, in the 
diagonal position, then the eliminant equals this last diagonal element. In symbols: 



a n 



a n -i,i 
0 



a\,n-\ 



®n—\,n—\ ®n—\,n 

0 a nn 



an 



a\,n-\ 



0 



a n -l,n-l 0 
®n,n— 1 ®nn 



Proof. We will prove the theorem for the row case by induction on n. The proof for the column case is 
similar. 

Basis step (n = 1): |an| = an. 
Inductive step (n > 1 ) : 



an 



a n -i,i 
0 



ai,n-i 



a In 



dn— l,n— 1 ®n—\,n 

0 a„„ 



bn 
b n -i,\ 



bl, n -\ 
b n -\,n-\ 



(1) 



where 



an 



Hence, for all j, 1 ^ j • ^ n — 2, 

bn-l,j 



an aij+i 
0 0 



0. 



an flij+i 
a n \ a n j + i 

Thus, all off-diagonal elements of the last row in the right-hand side eliminant in (1) are zero. Therefore, by 
the induction hypothesis, the eliminant equals b n -\^ n -\, which is 



An 


ain 




an ain 


a n \ 


ann 




0 a nn 



: a nn +0.a* n ain = a n 



□ 
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Theorem 4.8. If, in an nx n eliminant, the last row consists of zeros except for a one in column i, i < n, 
then the last row can be replaced by the i-th row. In symbols: 



a n 



an 



an 



a\ n 



an— 1,1 ■■■ a n —\i ••• a n —\ n 
0 ••• 1 ••• 0 



an 



an 



an 



a\ n 



an— 1,1 ■■■ a n —\i ••• a n —\ n 
an ' ' ' an • • • ai n 



Note: The right-hand side can also be written as A"~ . With the subscript (/*) denoting the ith row, the 
theorem may be rephrased as follows: If, for an n x n matrix A, the last row is the ith row of the identity 
matrix, A m = /,* for some i < n, then elim(A) = A" n _1 . 

Proof of Theorem 4.8. The proof follows by induction on n. For n = 1, the result is vacuously true. For 
n = 2, the only value for i is 1 . In this case, 



T ^ =Q+ l (a n )*a\ 2 = a* n a u = (l+a u a* u )an 
= a\2 + a\\a* n a\2 

For the induction step, let n > 2. Using the definition of eliminants, the left-hand side can be rewritten 



an an 
an a u 



as 



an a\2 

«2i a 2 2 

an a\2 

an a i2 



an an 
a n -\,\ a«- 1,2 



an an 
0 0 



an au 

a 2 i a 2 i 

an an 

an a ti 



a\\ au 
a n -i,\ a n -u 



an an 
0 1 



an a\ n 

a 2 \ a 2n 

an a\ n 

an ai n 



an a^n 

a n -\,\ a n -\n 



an ai n 
0 0 



This is an order n — 1 eliminant in which the last row is (O's, but 1 in the (i — l)st position). By 
the induction hypothesis, we can replace the last row by row i — 1. The resulting eliminant is seen to be 
equivalent to the right-hand side of the theorem by virtue of Definition 4.1. □ 

The analogous theorem for the column case is the following. 

Theorem 4.9. If in an nx n eliminant, the last column consists of zeros except for a one in row j, j < n, 
then the last column may be replaced by the jth column. 
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Note: With the subscript *j denoting the jth column, the theorem may be rephrased as follows: If, for 
an n x n matrix A, A*„ = hj for some j < n, then elim(A) = A"J 1 . 

Theorem 4.10. For any nxn matrix A, 



(1) A 

(2) % k =% k -\hk 



Xk-\ 



1 ^ i,j,k ^ n. 



(3) 

(4) A 



A k 
A kj 



(A 



k—l\*Zk—l 
kk ) A kj ' 



1 sC j,k sC n. 



'J - A ij 



IIS, IS, J t J IIS. IS, J 



1 ^ i,j,k < n. 



(5) A k ij =Af j + £ AfpApj, \^i^m^k^n,\^j^n. 

p=m+l 

Proof. (1) For the case k= I, the result is thus verified: 



an aij 
an aij 



Now, let 1 < ^ «, and consider the eliminant 





a n ■ 


■ a\,k-\ 


a\k 






dk-1,1 ■ 


• ak-\,k-\ 


a k -i,k 


a k-l,j 




a k \ ■ 


■ ak,k-i 


a-kk 


a kj 




an ■ 


■ ai,k-i 


a, k 


aij 



By Theorem 4.3, this can be rewritten as 



an 

an 
an 

an 



a\k-\ a\k 

ak-i,k-\ a k -i,k 
atk-i a k k 



a\.k-\ 



a\ k 



A k ~ l A 

A kk A kj 

7k-l Zk-1 

A ik A ij 



ak-\,k-\ a k -i,k 
ai, k -i a ik 
fe-i 



«n ••• ai,fe-i aij 



a k -i,i 
an 

a\\ ••• ai^-i a\j 



a k -i,k-\ a k-\.j 
ak.k-\ a k j 



A ij +A ik \ A kk ) A kj 



a k -i,\ ■■■ i 
an ■■■ a it k-i 

tk-\ I \k-\\* \k-\ 



(2) A* =^+A k k \A k kk 'yA k k ' 

=4- 1 (i+(^- 1 )^- 1 )=4- 1 (^- 1 )*- 



The proof of part (3) is similar. Part (4) is obvious from (1), (2), and (3). 

(5) This part follows by backward induction on m. For m = k, the result is immediate. For the inductive 
step, let 1 ^ m ^ k. We derive the result for m — 1: 
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7m-\ i 7m-\7k 



p=m 



Pj 



_ 7m-l i 7m- 1 7k , V" 1 Ajn-l 7 
p=m+\ 

( k \ k 

_ Im-l , 7m-\ 7m , y 7m 7k , V" 1 7m— I 7k 

\ p=m+l / p=m+l 

using the induction hypothesis, 

_ / 7m- 1 i 7m- 1 7m \ , y / 7 m- 1 7m , 7m-l\ 7, 
~ \ U ^ A im A mjJT [^im A mp^ A ip J A 



k 

pj 



&7j ■ L K l \j ^ing part (4) 

p=m+\ 

-Ajj by the induction hypothesis. □ 



5 Matrix asterates 

We are now in a position to define asterates for matrices over a *-semiring. We present a formal definition 
of A*, and then justify it by showing that A* = AA* +1 = A* A + /. 

Definition 5.1. Give an n x n matrix A, the asterate of A, denoted A*, is the n x n matrix (bij) given by 



an 



an 



aij 



a\ n 0 

an • • • an ■ ■ ■ atj ■ ■ ■ ai n 0 
aji ' ' ' aji ' ' ' a jj • • • aj n 1 



a n \ 
0 



ani 
1 



0 



a n n 0 

0 0 



Note: The above eliminant is obtained by bordering A at right and bottom; the bordering elements are 
all zero, except for l's in row j and column i. Thus, we can also write 



A 




li* 


\ 0 



Theorem 5.2. With A* defined as above, A* = AA* +1 = A*A + I. 

Proof. We will prove A* = AA* + /; the other part can be proven in a similar way. Let C = AA* + /. Then, 
for 1 < i,j < n, we have 

n 

Cij = 8,7 + ^ aikbkj, where 8,y = 1 if i = j, and 0 otherwise. 

k=\ 
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We can transform the right-hand expression as follows. First, we apply Theorem 4.4 to move the pre- 
multiplier a^ into the kth position in the bottom row of b k j. Next, we use Theorem 4.5 to carry out the 
summation of the k eliminants into a single eliminant. Finally, we use Theorem 4.6 to add the constant term 
8,y to the diagonal element in the bottom row. The result is 



an 



flu 
a jk 

a n k 
a ik 



a\ n 



*jn 



0 
1 



a nn 0 
a 



in 8(7 



Consider row i in the above eliminant. The last element of this row is 1 if i = j and 0 otherwise, that is, its 
last element is 87. It follows that the last row and row i are equal in the above eliminant. By Theorem 4.8, 
we can replace that last row by /*,-. But, then, the eliminant is bjj. Thus, bjj = Cij and A* = C = AA* +1. 

□ 

Theorem 5.3. For annxn matrix A, A* = (bjj) where 

bij=A1j + 8ij, l^ij^n. 
Proof. We use the definition of A* and Theorems 4.6, 4.8, and 4.9: 



+ 8,- 



A 






A 






A 


hj 




\ 0 




Ai* 






Ai* 


0 



A 


■A*j 


Ai* 





+&,■=#,+& 



IJ- 



□ 



Of course, the equality proved in this theorem could have been used alternatively to define matrix aster- 



ate. 



6 Matrix asteration algorithms 

In many applications of *-semirings, one is required to compute the asterate A* of A. One way to accomplish 
this is to use the following algorithm which was given in its present form by McNaughton and Yamada [11]. 
This algorithm is equivalent to the Gauss-Jordan elimination method for inverting matrices in linear algebra. 

Algorithm 6.1 

Input : An n x n matrix A. 
Output: Annxn matrix S. 
Claim : S = A*. 

begin 

1. fi(°):=A; 

2. for& := 1 ton do 
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3. 
4. 



for i := 1 to n do 
for j := 1 to n do 



5. 




+ b 



ik 



,(*-!) 



,(*-!). 
kj ' 



6. 



5:=fi( n )+/ 



end 



Theorem 6.2 (Correctness of Algorithm 6.1). When Algorithm 6.1 terminates, S = A*. 

Proof. We will first prove by induction on k that the matrices computed in steps 1 to 5 satisfy the 
relation 



= Afj l +A k ik 1 (A k k l J tfcj 1 by the induction hypothesis 
= A k j by Theorem 4.10(1). 
Now, from step 6, 

Sij = bf) + Sij, where 8,y = 1 if i = j, and 0 otherwise, 
= 4- + 5 i7 . 

Thus, S = A* by Theorem 5.3. □ 

Algorithm 6.1 requires n intermediate nxn matrices in addition to input and output matrices. It is possi- 
ble to do the asteration in place without requiring any other matrix storage by rescheduling the computations 
so that no entry is modified before its use. Specifically, we can use the following algorithm. 

Algorithm 6.3 (In place matrix asteration) 
Input : An nxn matrix A. 

Output: A is overwritten to contain its own asterate on termination. 



begin 

fork := 1 ton do 
begin 

for i := 1 to k — 1 , k + 1 to n do := a,-^^* ; 
for i := 1 to k - 1 , k + 1 to n do 
for j := 1 to k — 1 , k + 1 to n do 

for j := 1 to k — 1 , k + 1 to n do a^j '■= a^akf, 
akk '■= akk* 
end 

end 



b\f=A k j, O^k^n, l<i,y<n. 

For£ = 0, bf = a ij =A9 j . 
For 0 < k ^ n, 




from step 5 
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The proof that this algorithm correctly performs asteration is quite easy, The identities in Theorem 4.10 
can be used in establishing the fact that, after any iteration of the main loop (on k), the matrix entries will be 

Another asteration algorithm is given below, which corresponds to the Gaussian elimination method for 
inverting matrices in linear algebra. 

Algorithm 6.4 

Input : An n x n matrix A. 
Output: An n x n matrix S. 
Claim : S = A*. 

begin 

1. C(°):=A; 

2. for& := 1 tora do 

3. for i := k to n do 

4. for j := 1 to n do 

' C ij -— C ij ^ C ik \ C kk ) C kj ' 

6. for i := n downto 1 do 

7. for j := 1 to n do 

8. 4y := cg> + £ c«>4y; 

9. S:=D + / 
end 

Theorem 6.5 (Correctness of Algorithm 6.4). £/po« termination of Algorithm 6.4, S = A*. 
The proof of this theorem becomes obvious once the following lemma is shown. 

Lemma 6.6. Upon termination of Algorithm 6.4, the following hold: 

(1) c^Aij, l<i,y<n. 

(2) dij=A n w l<i,y<n. 

ft) W 

Proof. (1) Comparing Algorithms 6.1 and 6.4, we find that, for k = i,b\j and c-y have the same values. 
(2) This part follows by backward induction on i. For i = n, 

d n j = c£j from steps 6, 7, and 8, 
= A^j by equation (1). 

For the induction step, 1 ^ i < n, 

d . . .-cQ-V + f c {i - l) d,- 

a i-l,J — c i-l,j ^ L c i-l,k Uk J 
k=l 
n 

= ^i-i j + H ^j-i fc^fc/ by (1) ancl tne induction hypothesis, 

k=\ 

= A n i_ l j from Theorem 4. 1 0(5) . □ 
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7 Solution of linear systems of equations 

Theorem 7.1. A solution to the system of linear equations 
x\ = aux\ H Va\ n x n + b\, 



%n — &n\X\ ~\~ * * * ~\~ dnn%n ~\~ b n , 

is given by 

a u 



Xi = 



an 



a a 



0 



1 



a\ n b\ 

din bj 

@nn b n 

0 0 



1 < i ^ n. 



Note: The last row in the above eliminant consists of zeros except for a one in column i. Hence the 
solution may also be expressed as 



Xi = 



A B 

/, * 0 



where A, B are the matrix of coefficients and the vector of constants, respectively, in the system of equations, 
and /,* is the ith row of the identity matrix of the same size as A. Furthermore, by Theorem 4.8, the last row 
of the eliminant can also be replaced with row i; pictorially, 

A B 

Ai. 0 
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Proof of Theorem 7.1. For 1 ^ i ^ n, let X{ be defined as above. Then we have 



bi + a U x i 



7=1 



a n ■■■ an ■■■ a ln b\ 
an ■ ■ ■ an ■ ■ ■ bi 



0 • • • dij 

■ ■ an ■ 



= Xi. 



□ 



ann b n 

0 0 



by Theorem 4.4 



a\ n b\ 



an ■ 


• • an ■ 


ain 


bt 


a\ n \ ■ 


■ ■ a ni ■ 


ann 


b„ 


an ■ 


■ ■ an ■ 


a in 


bi 


an ■■ 


■ an ■ ■ 


■ a u 


bi 


an ■ ■ 


• an ■ ■ 


■ a in 


bi 


a n \ • • 


ani 


ann 


b n 


0 •• 


■ 1 •• 


■ 0 


0 



by Theorems 4.5, 4.6 and 4.7 



by Theorem 4.8 



If several systems of linear equations have to be solved simultaneously, the problem is formulated in 
terms of a matrix equation: For give n x n matrices A,B, find an n x n matrix X satisfying 



X=AX + B. 

Since A*B = (AA* +I)B = A(A*B) +B, we know that X = A*B is a solution of (2). 

To describe the solution in the form of eliminants, we will make use of the following theorem. 

Theorem 7.2. For nxn matrices A,B, CD, 



(2) 



A B 
C D 



[iJ] 



A B 
C D 



1 ^ i, j ^ n. 



J n+i,n=j 

Proof. Let E be the 2x2 eliminant (with nxn matrix entries) and F the (2n) x (2n) matrix, such that 



A 


B 




A B 


C 


D 


F = 


CD 
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Since E = D + CA*B, we have, for 1 ^ij^n, 

an ••• flu 



ey = dij + £ c a . £ 

fe=i /=i 



«n • • • aik 



0 ••■ 1 



a\ n 0 
ain 1 

0 0 



By repeatedly applying Theorems 4.4 and 4.5 and finally, Theorem 4.6, we can transform this into 
a n ■■■ a\„ b\j 



a n \ * * * a nn b n j 



which is F" +i n+ j. 



□ 



Theorem 7.3. A solution of the system 
X=AX + B, 

where A, B are given nxn matrices andX is annxn matrix of unknowns, is 

, l^ij^n. 



A 


B *j 




0 



A B 
I 0 

□ 



A B 
I 0 



n+i,n+j 



Proof. For 1 ^ij^n, 

Xi j = (A*B)[i,j] 

A B*j 
/«* 0 

Since X = BA* is clearly a solution of X = XA + B, we can similarly prove the following theorem. 
Theorem 7.4. A solution of the system 

X=XA + B, 
where A,B are given nxn matrices, is 

, l^ij^n. 



A 


hj 


Bu 


0 
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